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EFFICIENT INTRA- DOMAIN ROUTING IN PACKET -SWITCHED NETWORKS 



CROSS REFERENCE TO RELATED APPLICATIONS 
[0001] This application is the US National Stage of International 
Application No. PCT/EP2003/009231 , filed August 20, 2003 and claims 
the benefit thereof. The International Application claims the 
benefits of German application No. 10238291.3 filed August 21, 
2002, both applications are incorporated by reference herein in 
their entirety. 

FIELD OF THE INVENTION 
[0002] The invention relates to a method, an edge router and an 
internal router for routing data packets in a packet-switched 
network with traffic distribution 

BACKGROUND OF THE INVENTION 
[0003] An important area of work for network technicians, and routing 
and internet experts, is the further development of packet-switched 
networks. An important objective of this further development is to 
be able to offer a comprehensive spectrum of services over packet- 
switched networks. 

[0004] Apart from the conventional applications for data transmission, 
ever more services with real-time requirements, such as telephone 
(e.g. Voice over IP) and the transmission of image data in real time 
(e.g. video on demand, video conferences), are to be realized over 
packet-switched networks. From this arise new requirements which the 
packet-switched networks must meet. Adherence to quality character- 
istics for services with real-time requirements - frequently 
referred to in this context as the 'quality of service', abbreviated 
to QoS - is of central importance. 

[0005] The packet-switched networks which are currently most popular 
are based on the IP (Internet Protocol) protocol. The success of 
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these is to a large extent explained by their comparatively low 
complexity and high flexibility. Both of these arise from the way 
that packets are forwarded in the IP network. 

[0006] Within IP networks, the packets are routed by reference to 
their IP addresses. In the large majority of cases, the routing is 
effected on a per-hop basis, i.e. by reference to the packet address 
the routers identify a destination, normally another router, to 
which the packet concerned is forwarded. At the end of the 
transmission via a chain of routers, the packet is delivered to the 
destination address, often a host or a gateway. 

[0007] In general, no information relating to the transmission path is 
available to an individual router apart from details of the next hop 
or the next stage, as applicable. As a result, the maintenance and 
administration of the routing tables requires little effort. In 
addition, the method is flexible to the extent that alternative and 
default destinations can be provided for the next hop which, for 
example, ensure that the packet can be forwarded in the event of a 
malfunction or unknown addresses. 

[0008] IP networks using conventional routing techniques are not very 
suitable for real-time traffic. Delays to packets, and their loss, 
are not subject to sufficiently stringent controls to be able to 
guarantee the quality characteristics necessary for real-time 
transmission. 

[0009] Methods for better control of the transmission parameters 
include the reservation of transmission capacity for services with 
real-time requirements, and the specification of transmission paths 
in the network. The RSVP (Resource Reservation Protocol) signaling 
protocol was developed for the purpose of reserving bandwidth in IP 
networks. The RSVP protocol is used with, among others, the MPLS 
(Multi-Protocol Label Switching) protocol which permits the 
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transmission path to be defined. The MPLS protocol provides for a 
packet, when it enters into a network, to be allocated a label by an 
LSR (Label Switching Router) edge router, which defines an LSP 
(Label Switched Path) path through the network. The packet is then 
forwarded by internal LSR (Label Switching Router) routers according 
to the LSP path defined by the label. 

[0010] A choice of path is also made as part of the ATM (Asynchronous 
Transfer Mode) technique, and for IP networks can also be effected 
by means of the Source Route Option of the IP datagram (although in 
practice this is seldom supported) . 

[0011] The reservation of paths permits guarantee statements in 
respect of a QoS transmission, but is associated with high 
complexity and the loss of flexibility (by comparison with "best 
effort" packet-switched networks) . 

SUMMARY OF THE INVENTION 
[0012] The object of the invention is efficient routing, in terms of a 
QoS transmission over a packet-switched network, while avoiding the 
disadvantages of conventional methods. 

[0013] This object is achieved by the claims. 

[0014] As part of the invention, a method is proposed for the routing 
of data packets in a packet-switched network with traffic 
distribution. With this method according to the invention, a data 
packet is forwarded or routed, as applicable, by an internal router 
.within the data network, with the forwarding or routing respectively 
of the packet being effected by reference to at least two items of 
data. One of these two items of data is the interface or node, as 
applicable, where the data packet came into the packet-switched 
network, and the second item of data is the interface or node, as 
applicable, where the data packet is to leave the data network. By 
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contrast with conventional methods, such as the ATM technology or 
the MPLS technology, no complete path through the packet-switched 
network is defined. The only items fixed are the point at which the 
data packet accesses the network, and the point or interface where 
the data packet leaves the data network again. Within the packet- 
switched network use is made of traffic distribution. That is to 
say, for example, that alternatives are prescribed for routers to 
use in forwarding data packets, which they can use for the routing, 
for example if a link goes down or as part of a statistical 
distribution over alternative paths. For the definition of ingress 
or egress points for data packets (i.e. the interfaces at which the 
data packets respectively come into the network or leave the network 
again) , identifiers can be issued, for example, at edge nodes or 
ports of edge nodes, as applicable. An identifier of this type would 
then indicate respectively the node or the port of the node, at 
which the data packet comes into the packet-switched network or is 
to leave the packet-switched network, as applicable. 

[0015] Here, the term internal router or internal node is relative to 
the forwarding of the data packet through the packet-switched 
network, and includes all the routers or nodes, as applicable, which 
are not identical with the entry or exit nodes. The set of routers 
which have interface functions with respect to other networks, and 
topologically are located on the edge of the network, are called 
edge routers. The complementary routers are then called core 
routers. In the context of this terminology, the term internal 
router is not identical with core router. If, for example, the path 
of the data packet when it is routed through the packet-switched 
network passes through several core routers, only those two core 
routers at which the data packet respectively enters and leaves the 
network are also internal routers in the sense of the description. 

[0016] In the case of the packet-switched network, it can also be a 
partial network or subnetwork. In IP (Internet Protocol) systems 
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there are, for example, network architectures in which the network 
as a whole is subdivided into networks called "autonomous systems". 
The network according to the invention could be, for example, an 
autonomous system or that part of the whole network which lies 
within the area of responsibility of a service provider (e.g. ISP: 
internet service provider) . In the case of a subnetwork, service 
parameters can be defined for transmissions through the whole 
network, by traffic control within the subnetworks and efficient 
communication between the subnetworks . 

[0017] In a packet-switched network, traffic distribution is 
exercised. With this, routers in the data network can distribute 
traffic to alternative next stations or hops, as applicable. This 
distribution can be effected, for example, for each packet or for 
each flow. Routing via alternative routes or paths, as appropriate, 
can be .exercised in the event of the failure of connecting links or 
with the object of a more uniform distribution of the data traffic. 
The invention permits local decisions about the forwarding of data 
packets by reference to data about the entry and exit points. In 
general, the paths of data packets are not rigidly defined when they 
enter into the packet-switched network. 

[0018] The invention has the advantage of greater flexibility compared 
to methods which provide for the complete definition of the trans- 
mission path. Access controls at the edge of the. network can be used 
to ensure that the traffic incidence within the network remains 
within limits which permit transmissions with the QoS level. By 
means of traffic distribution within the network, it is possible to 
ensure that no bottlenecks arise on individual links. Problems of 
conventional packet-switched networks, such as the circulation of 
packets, are avoided. 

[0019] The involvement of data about the origin in a router's 
forwarding decision makes it possible to permit a greater diversity 
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of paths than with classical IP routing or ECMP (equal cost 
multipath) . The associated increase in the complexity of the routing 
tables is kept small in a network by the reduction of the routing 
tables to data relating to the entry and exit points (e.g. the 
ingress and egress node numbers); the resulting routing tables will 
generally be smaller than with classical IP routing. In contrast to 
MPLS, no explicit construction of paths is required, and all the 
network components can autonomously exploit the path diversity, to 
achieve a distribution of the traffic or fast local reaction to 
faults . 

[0020] Three possibilities for supplying the internal routers with the 
data about the entry and exit points are sketched out below. 

[0021] For example, at the entry point the data packet can be provided 
with one of more data fields or labels, as appropriate, containing 
the data relating to the entry and exit points for the data packet. 
This data field or fields, as applicable, can be prepended or 
attached to the data packet as a header or trailer respectively. 
Here, a data field can either contain the information about both the 
entry point and the exit point, or alternatively there can be a 
separate data field each for the data about the entry point and the 
exit point respectively. A bit sequence can be prefixed to the data 
fields or labels, as applicable, to identify them as -such. One 
option is to make use of MPLS labels, and to issue an MPLS label for 
each pair of ingress and egress nodes. For each of the labels, 
various alternative paths within the data network will then be 
defined. For the routing within the network, the internal router can 
then identify the label and make local decisions about which of the 
paths associated with the label to forward the data packet along. 
Logically, data packets in an end-to-end flow, i.e. data packets 
with the same origin and destination address data (e.g. IP addresses 
and possibly TCP port numbers), will be routed along the same path, 
in order to maintain the sequence of the data packets . 
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[0022] Data fields which were added to the data packet at either an 
ingress node or ingress router to the data network, as applicable, 
can be removed again at the egress point or egress router, as 
applicable. For example, routing tables can be maintained in the 
internal routers, defining a relationship between the data about the 
data packet's access interface and the data about the egress 
interface, on the one hand, and an address for the forwarding of the 
data packet. A table of this sort then comprises, for each pair of 
access and egress interfaces, the address of the next hop for the 
data packet. In addition to this, further alternative addresses can 
be arranged in the table, for use in traffic distribution or as a 
backup in the event of malfunctions or delays on one of the outbound 
links from the internal router. Instead of classically organized 
tables, it is also possible to perform a search using modern search 
structures and algorithms which, for example, proceed according to a 
tree structure. 

[0023] Another option for communicating to the internal router the 
data about the access interface or egress interface for the data 
packet is to make use of existing unused fields in the data packet. 
For example, the use of the source-route option of an IP datagram 
for storing address data for the data packet's ingress and egress 
interfaces is conceivable. These items of data would then be written 
into the datagram on its entry into the network, and then extracted 
from the datagram by the internal node in the course of the routing 
decision. The data about the access interface or egress interface, 
as applicable, could then be removed again from the fields in the 
data packet when it leaves the network, so that these fields are 
then available again for their original purposes. 

[0024] A third possibility is that the internal nodes identify the 
access point and the designated egress point for the data packet by 
reference to address data extracted from the data packet. 
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[0025] It is also possible to use an approach to the determination of 
the data about the interface at which the data packet accesses the 
packet-switched network and the data about the egress interface, at 
which the data packet is to leave the data network, which differs 
for the ingress and egress points. 

[0026] For example, when a packet enters the network the packet can be 
provided with a data field containing the identifier of the entry 
node. The internal router then extracts this identifier and, for 
example, uses a table to determine the egress node. Other 
combinations of different procedures, for determining the two items 
of data relating to the ingress interface and the egress interface, 
are also possible. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0027] The invention is explained in more detail below in the context 
of an exemplary embodiment, by reference to figures, in which: 

Figure 1 shows a simplified representation of a packet-switched 

network 

Figure 2 shows conventional routing tables for the typical 

network shown in Fig.l 

Figure 3 shows a schematic diagram of how labels are used 

according to the invention 

Figure 4 shows routing tables according to the invention 

DETAILED DESCRIPTION OF THE INVENTION 
[0028] Fig.l shows a simplified representation of a packet-switched 
network Nl . Connected to the packet-switched network Nl are the 
networks N2 to N4 . The networks N1-N4 allow the subscriber stations 
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or terminal devices T1-T9 to communicate with each other. Here, 
there are three terminal devices connected to each of the networks 
N2, N3 and N4 (T1-T3, T4-T6 and T7-T9). The packet-switched network 
Nl incorporates the nodes Kl, K2 and K3 , which are connected to each 
other via the connecting lines or links, L12, L13 , L23. The upper- 
most table in Fig. 2 specifies two paths for each of the various 
pairs of origin and destination networks. The first path specified 
represents the preferred path for a routing, which is aimed at the 
(minimal) number of intermediate stations or hops, as applicable. 
The second path represents in each case an alternative path which, 
for example, can be used as a substitute in the event of mal- 
functions or bottlenecks. By way of example, consider a data 
transmission from the network N2 to the network N3 . The "least cost" 
path goes via the nodes Kl and K2 . The alternative path avoids the 
link L12 by providing a forwarding chain K1-K3-K2. This alternative 
path will be used, for example, if the link L12 goes down. 

[0029] The second to fourth . tables in Fig. 2 show conventional routing 
tables in the nodes Kl, K2 and K3 . For a particular destination, 
each table shows the next station or hop, as applicable, and an 
alternative, corresponding to the paths specified in the uppermost 
table. As shown by the routing table in node Kl, data packets 
addressed to the network Nl can be communicated directly (locally) 
to the connected network Nl . This situation is represented in the 
table by the fields containing the term w local". Data packets 
directed to the network N3 are preferably routed on to the node K2 . 
As an alternative destination, the node K3 is tabulated. In an 
analogous way, data packets directed to the network N4 are 
preferably routed to the node K3 , and alternatively to the node K2 . 
The routing tables for nodes K2 and k3 are to be interpreted 
correspondingly . 

[0030] This combination of routing tables would permit, for example, a 
data packet which is sent from the network N2 to the network N3 and 
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which enters the network Nl at node Kl to be passed on initially to 
the node K3 , and by this latter to then be passed back to the node 
Kl. Such cases can arises, for example, with load balancing for the 
purpose of improved utilization within the packet-switched network 
Nl over the preferred and alternative paths. If, for example, data 
packets basically have an eighty percent probability of being routed 
along the preferred path and a twenty percent probability of being 
routed via the alternative path, then this situation occurs with a 
probability of 0.2 * 0.2 * 100 = 4%. I.e. loops occur. Loops must 
particularly be avoided if traffic restrictions and traffic controls 
in respect of QoS guarantees are applied at the boundaries of the 
packet-switched network Nl . 

[0031] Using classical IP routing, which only takes into consideration 
the destination address of a packet, this problem cannot be solved 
without restricting the path diversity. In the present example, it 
would be necessary to remove the alternative paths for at least two 
of the nodes in order to guarantee loop-free forwarding. This is at 
the same time the maximum path diversity which can be achieved using 
such mechanisms as ECMP (equal cost multipath) with manual setting 
of the cost parameters, or using the EIGRP (enhanced interior 
gateway routing protocol) and unequal cost multipath routing. 

[0032] One option -for getting round the destination-based routing is 
the presetting of the transmission path, e.g. as part of the MPLS 
concept. In this case, a number of bits (a "label") are prefixed to 
each IP packet, giving a path reference. However, MPLS has the dis- 
advantage that the original choice of path made by the router at the 
ingress point to the network (the "ingress router") cannot then be 
modified by subsequent nodes on the path. 

[0033] Fig. 3 illustrates the method according to the invention using 
data fields or labels for routing with the packet-switched network 
Nl. It shows the packet-switched network Nl together with the 
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networks N2 and N3 . A data packet which is to be transmitted from 
network N2 to network N3 is modified at node Kl, i.e. at its ingress 
router. The labels EL (for Egress Label) and IL (for Ingress Label) 
are attached as a header to the data packet. The label IL includes 
an identifier for the ingress router and the label EL includes an 
identifier for the egress router, at which the data packet is to 
leave the network again. As an option, an additional bit sequence 
LC* (LC for label code) can identify the labels IL and EL as such. 
Fig. 3 shows schematically an IP packet with such labels EL, IL and 
LC, which are added when the data packet enters the network Nl at 
node Kl and are removed again when it leaves the network Nl at node 
K2. 

[0034] The contents of the labels EL and IL are: for IL the number of 
the node Kl and for EL the number of the node K2 . These node numbers 
can be issued, for example, during installation of the network 
nodes, so that within any packet-switched network or autonomous 
system (the latter expression is frequently encountered in English- 
language literature) which is under consideration they are in each 
case unique. Each ingress node to the network can use its own node 
number as the IL label. The node number of the egress node or the 
label EL, as applicable, can be determined by reference to classical 
packet-switched network routing data, e.g. the destination IP 
address recorded in the packet. The node number thus determined for 
the egress node will then be used as the label EL. 

[0035] Within the network it is now no longer necessary to consider 
the origin and destination addresses in the header of the data 
packet. The next node can be determined solely by reference to the 
data fields IL and EL (or a single combined label) prefixed to the 
packet. By this means, the routing tables are substantially reduced 
in size. Furthermore, by combining the data fields IL and EL to form 
a pseudo MPLS label, the communication format of the packets could 
be kept compatible with MPLS. 
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[0036] Fig. 4 shows routing tables according to the invention for the 
example shown in Fig. 1. To the nodes Kl, K2 and K3 are assigned the 
node numbers or node identifiers, as applicable, KN1 , KN2 and KN3 . 
An ingress node, for example node Kl, then uses its own node number, 
i.e. KN1 for node Kl, for the label IL. The node identifier for the 
label EL is determined by reference to a table. Each network node in 
Nl which is connected to external networks then has a table for use 
in determining the egress node. An example of such a table is given 
by the uppermost table in Fig. 4. When a data packet is transmitted 
from the network N2 to the network N3 , the ingress node Kl extracts 
from the aforementioned table in Fig. 4 the node number KN2 for the 
egress node K2 . The node number KN2 is then used for the label EL. 
In the table, the networks N2 , N3 and N4 each stands for its network 
nodes and all the further networks which can be reached through it. 
The tables for determining the EL have roughly the size of a BGP 
routing table (BGP: Border Gateway Protocol) . Correspondingly, the 
search effort to determine a label EL will also be of a similarly 
moderate level as for the determination of a next-hop router using 
the BGP protocol. 

[0037] The other tables in Fig. 4 are the analogs of the routing 
tables in Fig. 2 for the method according to the invention. The 
routing tables now have one entry for each ingress/egress node pair. 
If the packet is to leave the network Nl at one of the nodes, the 
label is removed again and the next node is determined using the 
external routing protocol (in the literature the expression exterior 
gateway protocol, abbreviated to EGP, is common) . The BGP (border 
gateway protocol) is often used for this purpose. For example, 
suppose a data packet is sent from the network N2 to the network N3 . 
The ingress node Kl determines the egress node K2 , and prefixes the 
identifiers KN1 and KN2 of the ingress and egress nodes to the data 
packet as a label . According to the routing table for the node Kl in 
Fig. 4, for the egress /ingress label pair KN2 and KN1 the preferred 
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next node is K2 . As an alternative, the data packet is routed to the 
node K3 . In the first case - as stipulated in the third table in 
Fig. 4 - the next hop will be determined by node K3 using an EGP 
protocol (here,, the asterisk is a dummy which stands for any 
arbitrary node identifier) . In the second case - lowermost table in 
Fig. 4 - node K3 determines the node K2 as the next hop. There is no 
alternative hop or alternative address, as applicable. A loop is 
thereby avoided. 

[0038] The node numbers can be issued manually when network nodes are 
installed. However, preference should be given to automated 
mechanisms. For this purpose, a protocol can be executed between the 
routers, by which they autonomously reach agreement on their node 
numbers (for example by reference to the sequence of their IP 
addresses in the network under consideration) and then distribute 
amongst themselves the tables for determining the egress label EL. 
If new nodes are inserted into a network which is currently in 
operation, they can each be given the next unallocated node number. 
In order to manage the process of combining previously separate 
networks which are currently in operation, further mechanisms are 
generally required. 

[0039] One alternative to automatic self -configuration is 
configuration by a central station, for example as part of the 
network management procedures. To this end, a network can initially 
be started up in the normal IP routing mode. The node numbers are 
then issued by the network management procedures, and only then are 
the processes for attaching the labels and distributing the traffic 
across several paths started up. 

[0040] In order to ensure that the free distribution of packets over 
various paths does not disrupt any sequence of packets which belong 
together semantically (for example packets for the same TCP link), a 
node at the network ingress can add to the label a further field, FI 
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(flow identifier), containing for example a value calculated from 
the origin and a destination addresses for the packet (e.g. IP 
addresses and any port numbers) . Subsequent nodes in the network 
must then either note in a dynamic table the path decision made for 
each value of the field FI, or must assign the FI values to 
particular routes in a systematic way (for example by splitting up 
the value range of FI) . In the event of faults, the association 
between FI and path decision can be changed locally and dynamically 
at each node. 

[0041] Using algorithms, the routing tables can either be calculated 
centrally and distributed to all the nodes, or they can be 
calculated autonomously in each node, for example using the link- 
state data exchanged with the help of the OSPF (Open Shortest Path 
First) protocol. 

[0042] The method described can also be used without the communication 
of ingress/egress numbers in labels. To do this, two further tables 
are provided in each network node, using which it can calculate for 
itself the appropriate data for each packet. In this case, the EL 
table corresponds to the EL table explained above by reference to 
Fig. 4. A corresponding IL table can be created in the same way from 
the external (EGP) routing tables if symmetric routing is ensured in 
the EGP. Here, symmetric routing means that the path of data packets 
is invariant with respect to the direction of transmission, i.e. 
unaffected by swapping the origin and destination addresses in the 
header of the data packet. In creating an IL table, a relationship 
is set up between the origin addresses and the access interface or 
access node, as applicable. The access interface is determined for a 
particular data packet by using the EGP to determine the egress 
interface or egress node, as applicable, of data packets for which 
the destination address is the same as the origin address for the 
particular data packet. Due to the symmetry of the routing, the 
interface or node determined in this way will be the ingress 
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interface or ingress node, as applicable, of the data package. 

[0043] On grounds of security it is in any case often desired to check 
whether the origin address of an IP packet at its ingress into a 
network is in agreement with the physical ingress point, so this 
requirement for symmetrical routing may well be satisfied in future 
as a matter of course. 

[0044] The concept can also be realized with only an ingress label IL. 
In this case the local routing tables would contain, instead of the 
egress label EL, the usual network addresses, and would be 
correspondingly larger, but the network ingress nodes would be saved 
from the need to look up the egress labels. 
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